System and method for providing timing data for programming events

ABSTRACT

A video production facility system may produce closed caption data that includes text data and timing data. The system may receive script data for a video program. The system may then determine identifiers for individual programming events that make up the program. The system may then produce closed caption data for the program. The closed caption data may include text data corresponding to the script data, and timing data provided at locations that correspond to the beginning of each of the programming events. The timing data may comprise an identifier of the corresponding programming event. Further timing data may be provided that marks the ends of programming events, or that marks individual segments within a programming event. Related embodiments may pertain to systems that implement such processing. The closed caption data may be synchronized to a video signal based on the display of corresponding text by a teleprompter system that is used in the production of the video program. Timing data may alternatively be provided within the video signal itself.

BACKGROUND TECHNOLOGY

[0001] Television viewers are presently able to access hundreds ofchannels providing a multitude of programs, only a small fraction ofwhich will be of interest to a given viewer. To assist the viewer indetermining programs of interest, current commercially availablereception devices such as televisions, analog cable receivers, anddigital cable and satellite receivers typically provide a program guidefunction that allows the viewer to access a grid showing programs thatwill be available on various channels in upcoming time slots. Briefdescriptions of programs may also be accessible. Such receivers may alsoallow the user to search for programs in basic categories such as news,sports, movies, etc.

[0002] Current commercially available television recording technologyalso provides similar tools. The present generation of digital videorecording machines, which typically store video on a bulk storage devicesuch as a hard disk drive, allow users to select programs for recordingusing an on screen program guide that provides keyword searching ofprogram titles, a program time grid, and basic program categorization.

[0003] Although these devices provide tools that improve over devices ofearlier generations, most conventional tools still require viewers toexamine all upcoming programs to identify programs of interest. Thus,developers of the next generation of devices are focused on providingintelligence in receiving and recording devices for identifying programsof interest on behalf of the user. A number of U.S. patents describedifferent approaches to this problem.

[0004] U.S. Pat. No. 5,223,924 describes a device that downloads programdescriptions. The program descriptions are viewed individually by auser, who indicates whether he is interested in each program. Based onthe user's input, the device builds a database of keywords associatedwith the user's positive and negative preferences. This database is thenused to identify upcoming programs that may be of interest to the user.

[0005] U.S. Pat. No. 5,410,344 describes a device that stores a viewerpreference file that reflects the viewer's positive and negativepreferences concerning various program attributes. The device uses thepreference file to analyze content codes that describe attributes ofavailable programs, and presents a program to the user based on theanalysis. Programs are ranked using a neural network thresholdingmethod.

[0006] U.S. Pat. No. 5,434,678 and its related patents describe a videoretrieval system in which individual portions of scenes within a videoare rated in accordance with a rating system and a version of the videois presented by selecting the segments that are acceptable based on auser's content preferences. Similar technology is described in U.S. Pat.No. 5,717,814 and its related patents.

[0007] U.S. Pat. No. 5,444,999 describes a device that tracks theviewing habits of a user and builds a weekly viewing trend. The devicenotifies the viewer when the television is tuned to different channel inconflict with the viewing trend.

[0008] U.S. Pat. No. 5,534,911 describes a system in which a viewerbuilds a personal profile that is then used to analyze data describingavailable programs. Programs are selected based on the analysis and aremade available on a personalized virtual channel. The viewer is alsoenabled to select from among programs that are ranked in accordance withthe profile. The specific manner in which program analysis is performedis not described.

[0009] U.S. Pat. No. 5,585,865 describes a system that searches for agenre code in broadcast signals in accordance with a specified programgenre. If more than one signal contains the desired genre code, thesystem displays the channel with the greatest display history.

[0010] U.S. Pat. No. 5,619,247 describes a video recording device thatselects programs for storage based on predefined user preferences, andallows a user to view the stored programs on a pay-per-view basis.

[0011] U.S. Pat. No. 5,767,893 describes a system that uses contentbased filtering for identifying video programs to be stored. Thespecific manner in which content is filtered is not described.

[0012] U.S. Pat. No. 5,878,222 describes a system that monitors channeldata describing contents of available channels and arbitrates access todisplay or storage resources based on a user profile.

[0013] U.S. Pat. No. 5,945,988 describes a system that monitors theprograms viewed by a current viewer and determines the identity of thecurrent viewer using stored viewer profiles. The system may then use theviewer profile to analyze metadata describing upcoming programs toidentify programs for viewing or recording. The specific manner in whichthe metadata analysis is performed is not described.

[0014] U.S. Pat. No. 6,088,722 describes a system in which a userprofile is compared to program content profiles to generate an agreementmatrix for each program. The agreement matrixes are used to select aprogram for presentation to the viewer. Agreement matrixes may also begenerated at a server end using profiles for multiple viewers to selectprograms to be made available from the server.

SUMMARY OF THE INVENTION

[0015] One shortcoming of the conventional technology as described aboveis that programs must be evaluated on a whole-program basis. However,many programs address diverse subjects, some of which will be ofinterest to a particular viewer and some of which will not. Embodimentsof the invention address this problem through devices and processes forgenerating metadata for individual program segments, thus allowingprogram segments to be treated as individual programming events that canbe individually evaluated by the user or by user equipment. Relatedembodiments of the invention are applicable to programs such as newsbroadcasts that are multi-segmented and are typically not described indetail in conventionally available information sources because theircontents are typically not known until shortly before broadcast. Inaccordance with embodiments of the invention, the production data usedto produce such programs may be processed to generate metadata for theindividual segments of the program and to distribute that metadata toconsumers in advance of the airing of the program.

[0016] A further shortcoming of the conventional technology is thatprogram classification is limited to broadly defined subject categoriesthat are typically not easily compared to an individual viewers'personal tastes. For example, conventional technology may be capable ofclassifying programs as being within the category of “sports.” However,for the viewer who is only interested in a particular sport, or aparticular team, such classification is not effective in identifyingprograms of particular interest. Embodiments of the invention addressthis problem through the use of a content classification hierarchy forclassifying the content of programming events and for defining viewer'sparticular interests. The classification hierarchy is comprised of treesof subject categories of increasing specificity. This allows programmingevents to be classified with a previously unattainable degree ofspecificity, and allows viewer preferences to be expressed with equalspecificity, both to emphasize particular categories of interest and toexclude categories not of interest. For example, rather than simplybeing enabled to specify interest in “sports”, a viewer may specify thathe is interested in football and tennis but not basketball or baseball,and may further express interest in particular football teams. Thus,devices may evaluate programming events that are rated according to theclassification hierarchy, using viewer profiles defined according to thesame classification system, and the resulting evaluations reflect actualuser preferences much more accurately than if conventional generalcategories were used. Further, among multiple programs that areevaluated as being of interest to a viewer, the degree of specificity ofthe matches provides a manner of ranking those programs based on viewerpreferences.

[0017] The use of hierarchical classification as described above enablesintelligent identification of programming events that will be ofparticular interest to a given viewer. This intelligence may beimplemented to automatically record programming events of interest, toalert a viewer of upcoming programming events of interest, toautomatically display programming events of interest as they becomeavailable, or to selectively provide programs to the viewer. When thisintelligence is coupled with metadata describing individual programsegments as described above, it becomes possible to provide the viewerwith a truly personalized viewing experience, from which alluninteresting subject matter has been eliminated through deep contentspecific filtering at the program segment level.

[0018] Further embodiments of the invention may combine the use of acontent classification hierarchy with keywords for furthercharacterizing programming events. Keywords may be given scores tocharacterize the degree to which they are descriptive of the programmingevent. In some embodiments, a keyword may be associated with a categoryof a classification hierarchy in a device that analyzes programmingevents to more precisely indicate the manner in which the keywordcharacterizes the subject matter of interest to the viewer. Relatedembodiments of the invention may therefore evaluate programming eventsusing a combination of keyword matching and category matching.

[0019] Further embodiments of the invention may utilize interactiveprocesses whereby personnel involved in the production of a programmingevent are enabled to participate in the generation of metadata for theprogramming event through an interactive process, whereby preliminarymetadata produced by a system is either approved or edited to reflectthe judgment of the production personnel as to various aspects such asthe categories used to described the programming event, scoresassociated with the categories, keywords and their scores and categoryassociations, and a title for the programming event.

[0020] Further embodiments of the invention may utilize timing data thatis inserted in a closed caption data stream to mark at least thebeginnings of programming events with precision so that a recordingdevice is enable to determine the beginning of the programming event.The timing data may be created at the time that the rest of the closedcaption data is created for the programming event, and closed captiondata including such timing data may be synchronized to the programmingevent through triggering by a teleprompter system. A recording devicemay use the timing data to initiate, pause, un-pause and terminaterecording. Related embodiments may incorporate such timing data in thevideo signal itself.

[0021] In accordance with one embodiment of the invention, a videoproduction facility system may closed caption data that includesconcurrently produced text data and timing data. The system may receivescript data for a video program. The system may then determineidentifiers for individual programming events that make up the program.The system may then produce closed caption data for the program. Theclosed caption data may include text data corresponding to the scriptdata, and timing data provided at locations that correspond to thebeginning of each of the programming events. The timing data maycomprise an identifier of the corresponding programming event. Furthertiming data may be provided that marks the ends of programming events,or that marks individual segments within a programming event. Relatedembodiments may pertain to systems that implement such processing.

[0022] In accordance with a further embodiment of the invention, asystem may produce closed caption data that includes timing data andtext data. The timing data may be provided at locations in the closedcaption data that correspond to beginnings of programming events withinthe video program. A video signal may then be produces for the videoprogram. The closed caption data may be synchronized to the video signalin accordance with display of corresponding text by a telepromptersystem that is used in the production of the video program. Relatedembodiments may pertain to a systems that implement such processing.

[0023] The following description of various embodiments discloses avariety of additional features that may be implemented in conjunctionwith the various embodiments summarized above and in furthercombinations that will be apparent to those having ordinary skill in theart.

BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The invention may be better understood with reference to thefollowing figures. The components in the figures are not necessarily toscale, emphasis instead being placed upon illustrating the principles ofthe embodiments of invention described in conjunction therewith.

[0025]FIG. 1 illustrates a system for providing metadata and programmingevents to a client device in accordance with an embodiment of theinvention;

[0026]FIG. 2 illustrates a process in a system such as the system shownin FIG. 1;

[0027]FIG. 3 illustrates an example of production data comprising HTMLscript data produced by a conventional production application;

[0028]FIG. 4 illustrates an example of production data comprisingrundown data produced by a conventional production application;

[0029]FIG. 5 illustrates a system for providing metadata and programmingevents to a client device in accordance with an embodiment of theinvention;

[0030]FIG. 6 illustrates a process in a system such as the system shownin FIG. 5;

[0031]FIG. 7 illustrates metadata in accordance with an embodiment ofthe invention;

[0032]FIG. 8 illustrates a portion of a classification hierarchy inaccordance with an embodiment of the invention;

[0033]FIG. 9 illustrates a process for generating metadata in accordancewith an embodiment of the invention;

[0034]FIG. 10 illustrates a process for generating keyword metadata inaccordance with an embodiment of the invention;

[0035]FIG. 11 illustrates an interactive process for generating metadatain accordance with an embodiment of the invention;

[0036]FIG. 12 illustrates a client device in accordance with anembodiment of the invention;

[0037]FIG. 13 illustrates a viewer profile in accordance with anembodiment of the invention;

[0038]FIG. 14 illustrates a process for producing a preferredprogramming event schedule in accordance with an embodiment of theinvention;

[0039]FIG. 15 illustrates a process for selectively notifying a viewerof a programming event and recording a programming event in accordancewith an embodiment of the invention;

[0040]FIG. 16 illustrates a process for assigning a desirability scoreto a programming event based on category matching using a viewer profilein accordance with a preferred embodiment of the invention;

[0041]FIG. 17 illustrates a process for assigning a desirability scoreto a programming event based on category matching using multiple viewerprofiles in accordance with a preferred embodiment of the invention;

[0042]FIG. 18 shows a process for ranking programming events based oncategory matching and keyword matching in accordance with a preferredembodiment of the invention;

[0043]FIG. 19 shows a process for ranking programming events based oncategory matching, keyword matching and qualified keyword matching inaccordance with a preferred embodiment of the invention;

[0044]FIG. 20 shows timing data included in a closed caption data streamin accordance with a preferred embodiment of the invention;

[0045]FIG. 21 shows a system for producing closed caption data inaccordance with a preferred embodiment of the invention;

[0046]FIG. 22 shows a process in a client device utilizing closedcaption timing data in accordance with a preferred embodiment of theinvention;

[0047]FIG. 23 illustrates a system for providing programming events inaccordance with an embodiment of the invention;

[0048]FIG. 24 illustrates a process in a system such as the system shownin FIG. 23;

[0049]FIG. 25 illustrates a system for providing alerts regardingprogramming events to viewers in accordance with an embodiment of theinvention; and

[0050]FIG. 26 illustrates a process in a system such as the system shownin FIG. 25.

DESCRIPTION OF PREFERRED EMBODIMENTS

[0051] In the following description, details of preferred embodimentsand certain alternative embodiments in accordance with the invention areset forth. However, it will be apparent to those of ordinary skill inthe art that alternative embodiments of the invention may be implementedusing only some of the features of these embodiments, and usingalternative combinations of the features of these embodiments. Whilevarious operations may be described herein in a particular order and asdiscrete tasks, the order of description should not be construed toimply that the tasks involved in those operations must be performed inthe order in which they are presented or that those tasks must beperformed discretely. Further, in some instances, well known featuresare omitted or generalized in order not to obscure the description. Inthis description, the use of phrases such as “an embodiment,”“embodiments,” “preferred embodiments,” “alternative embodiment” and soforth do not necessarily refer to the same embodiment or allembodiments, although they may.

[0052] The following description employs the terms “program,” “programsegment” and “programming event.” These terms are used to describedifferent but related concepts. The term “program” is used in theconventional sense of a video program such as a television program. Forpurposes of this description, a program comprises one or more “programsegments” that pertain to different subjects and therefore can stand ontheir own as complete or individual viewing experiences. Examples ofprograms that typically consist of a single programming segment aremovies, sit-coms, and sporting events. Examples of programs that aretypically comprised of multiple program segments are news broadcasts,news magazine shows that present multiple feature stories, sportshighlight shows, music video shows, informational shows, home shoppingshows, and variety shows.

[0053] The term “programming event” is used in this description todescribe a distinct video production presentation that pertains to aparticular subject and therefore stands on its own as a complete orindividual viewing experience. Therefore, a given programming event maybe a segment of a program, or it may be a whole program if that programconsists of only one program segment.

[0054]FIG. 1 provides an overview of a programming event distributionsystem in accordance with embodiments of the invention. Referring toFIG. 1, a metadata generator 18 generates metadata 20 that isdescriptive of a video programming event. The metadata generator 18 istypically implemented as a computing device including a processor orprocessors to execute programming instructions and memory coupled to theprocessor(s) and containing programming instructions for instantiating ametadata generator system, details of which are described below. Themetadata 20 is provided by a metadata distributor 22 to a client device26 maintained by a viewer. The client device 26 also receivesprogramming events 28 from a programming event provider 24. In variousembodiments, the metadata distributor 22 and programming event provider24 may be a single entity such as a television broadcasting station or acable or satellite television provider. In other embodiments, themetadata distributor 22 and the programming event provider 24 may beseparate entities. For example, the metadata distributor 22 may be aninternet server, whereas the programming event provider 24 may be atelevision broadcasting station or a cable or satellite televisionprovider. The metadata 20 provided by the metadata generator 18 istypically received by the client device 26 in advance of correspondingprogramming events 28 to allow sufficient time for processing of themetadata in order to evaluate the desirability of upcoming programmingevents to the viewer.

[0055] The metadata generator 18 generates metadata 20 that describesprogramming events in a standard format that may be processed by theclient device 26. Metadata typically comprises delimited data associatedwith fields in a generic metadata format, and typically includes atleast data describing the subject of a programming event and datadescribing the time and duration of the programming event.

[0056] The metadata generator 18 may receive as input conventionalprogram descriptive data (PDD) data 14 that is provided by a commercialPDD provider 10. Current providers of conventional PDD data are TribuneTV, TV Data, and TV Guide. The conventional PDD data describestelevision programs through information such as the program title,program start time, and program duration. PDD data may also include aprogram subject description if the program is one that is produced, orcapable of being described, significantly in advance of itstransmission. Typical examples of programming events for which PDD datacontains subject descriptions include movies, sit-coms, and sportingevents.

[0057] The metadata generator 18 may also receive production data 16from a production facility agent 12 that obtains the production datafrom production equipment of a production facility. The productionfacility agent 12 is typically implemented as a computing deviceincluding a processor or processors to execute programming instructionsand memory coupled to the processor(s) and containing programminginstructions for instantiating a production facility agent system,details of which are described below. The production facility agent ispreferably implemented on the production facility equipment so as tocooperate with the production facility software to obtain productiondata. Production data 16 provided by the production facility agent 12generally includes data that is used in the production of a program,such as scripts, cue sheets, schedules, rundowns, closed caption text,teleprompter text, editing information, as so forth. Unlike conventionalPDD data, production data used in accordance with the invention includesdescriptive information (scripts, segment titles, segment descriptions,etc.) that is associated with timing information, thus enablingindividual program segments within a program to be identified andindividually described with respect to both their subjects and theirtimes and durations. Thus, production data enables the generation ofmetadata for individual segments of programs, and as a result, programsegments such as individual news stories, variety show skits and soforth may be individually analyzed and provided with their own metadata.

[0058] Production data is typically stored in computer systems and mayexist in a variety of formats. Examples of conventional softwareapplications that generate production data include the Associated PressElectronic News Production System (ENPS), AVID iNEWS NRCS, Avstar, andNewsCenter production software. Some such systems may conform to theMedia Object Server (MOS) protocol, which is commonly used in productionfacilities to provide control of production facility equipment, such astransmission of script data to closed caption generation devices orteleprompter devices.

[0059]FIG. 3 shows an example of production data generated by theconventional ENPS system. The production data of FIG. 3 includes scriptdata that is formatted as HTML code. Within the HTML code are individualsections corresponding to individual segments of a news broadcast. Thesesegments are demarcated by tags having the format <A name=______>,examples of which are highlighted in FIG. 3 for purposes ofillustration. FIG. 4 shows a further example of production datagenerated by the conventional ENPS system. The production data of FIG. 4comprises “rundown” data that provides a duration and ending time ofindividual segments within a news broadcast. The rundown data of FIG. 4is derived from script data, with the timing for each segment of theprogram being calculated using an average read rate that is specific tothe person reading the script for that segment. The rundown data of FIG.4 is one example of rundown data that may be derived from script data,and in alternative forms the rundown data may include any otherinformation from the script data.

[0060] It will be seen by comparison of FIGS. 3 and 4 that a common setof identifiers is used for identifying segments in the script data andin the rundown data. For example, the segment identified as “125TERROR”in the HTML script data can be seen in the rundown data to have a totaltime of 2:23 and an ending time of 2:26 into the news broadcast.Although the data in FIGS. 3 and 4 pertain to a program in whichindividual segments are described by single sections in the HTML dataand rundown data, other programs may have individual segments that aredescribed by multiple sections in the HTML data and rundown data, forexample, when the segment consists of multiple distinct “live” and videoportions. Thus the production data of FIGS. 3 and 4 is meant to beexemplary and not descriptive of all production data. Further, theproduction data of FIGS. 3 and 4 is representative only of data producedby one conventional production system, and a variety of other dataformats will be known to those familiar with video productionapplications.

[0061] Since production data may exist in a variety of types andformats, it is preferable that the metadata generator 18 includes aproduction data standardization agent that receives production data fromthe production facility agent 12 in its various native formats andprocesses the production data 16 into a standardized delimited form.Alternatively, the production facility agent 12 may providestandardization functions. In the metadata generator 18, the productiondata 16 is preferably processed together with any available PDD data togenerate metadata for individual programming events.

[0062] Processing performed in a metadata generator in accordance withembodiments of the invention is illustrated in FIG. 2. For purposes ofillustration, the tasks performed in the process of FIG. 2 will berelated to the production data of FIGS. 3 and 4. Initially, the metadatagenerator receives production data for a program (30). The productiondata includes timing data and descriptive data for the program, such asis contained in the HTML script data and rundown data of FIGS. 3 and 4.The received production data may be processed to conform to a standarddelimited format, for example, by tagging using an appropriate set ofXML tags. Referring to FIGS. 3 and 4, the HTML data of FIG. 3 may beparsed into script data for individual segments by examining thecontents of delimiting tags such as the <A name=______> tag andextracting all text data associated with the same or relatedidentifiers. Similarly, the rundown data may be parsed into rundown datafor individual segments by searching for delimiting data or charactersand extracting Total and Back Time data associated with the same orrelated identifiers.

[0063] The production data is then processed to determine time data ofprogramming events within the program (32). Time data is data thatenables determination of when the segment begins and ends, and maycomprises beginning and ending times, a beginning time and duration, oran ending time and duration. Referring to the rundown data of FIG. 4,time data for segments may be determined through reference to the Totaltime and Back time associated with each identifier. For example, if theprogram represented by FIG. 4 is a 12 noon news program, the ending timeof the segment may be determined by adding the latest Back Time for thesegment to the 12 noon start time of the program, and the starting timemay be determined by subtracting the Total time from the ending time.The production data is also processed to determine descriptive data foreach programming event (33). This may be done before, after, orcontemporaneously with the determination of time data. Descriptive datamay be determined through reference to script data as shown in FIG. 3.For example, keywords and descriptive phrases may be extracted from thescript data. Metadata for the programming events is then generated andstored (34). The metadata for each programming event comprises at leasttime data and descriptive data. PDD data and other types of productiondata may also be processed to generate time data and descriptive data.

[0064] Although the process of FIG. 2 was described as occurring withina metadata generator, in alternative embodiments the task of processingthe production data into a standard delimited format for individualprogramming events may be performed by the production facility agent. Insuch embodiments, the production data is provided to the metadatagenerator in a standard delimited form, such as an XML document.

[0065] As described with respect to FIG. 1, metadata may be provided toconsumers by a provider of programming events or by an independentmetadata distributor. FIG. 5 illustrates an embodiment of the systemillustrated in FIG. 1 in which programming events occurring within amulti-segment program such as a live local news broadcast are providedthrough a transmission system in common with the programming events. Inthis embodiment, a metadata generator 18 receives production data 16from a production facility agent 12 that obtains production data fromproduction equipment 36 in the production facility where the program isproduced. The metadata generator 18 may be local or remote with respectto the production facility agent 12. In typical implementations, themetadata generator 18 is connected to the production facility agent 12through a data network such as a LAN, WAN, or the internet. The metadatagenerator 18 may also receive PDD data 14 from an PDD provider 10. PDDdata may likewise be received through a data network. The metadatagenerator 18 generates metadata 20 for each segment of the program fromthe production data, and optionally also from the PDD data. Metadata 20for each programming event within the program may then be provided fromthe metadata generator 18 to the production facility agent 12, where itmay be provided for transmission in common with programming eventsthrough a transmission system 38, such as RF airwaves or cable orsatellite distribution systems, for reception by a client device 26. Themetadata may then be transmitted to client devices, in the case of aproduction facility agent at a broadcast production facility locationsuch as a local television station. Alternatively, the metadata may beprovided to a distribution agent 35 that transmits the metadata througha transmission system 38 independently of the transmission ofprogramming events from the production facility. The distribution agentmay be located, for example, at a cable system head end.

[0066] A variety of coding standards may be used for encoding themetadata, such as the Harris Communication, Divicom, and NDS standards.Metadata may be transmitted in the vertical blanking interval of thevideo signal. Alternatively, where programming events are broadcastusing MPEG-2 digital video, the metadata may be encoded in the textportion defined by the MPEG-2 standard. In cable televisionsapplications, it is preferable to transmit the metadata by out of bandsignaling, such as by using the separate band reserved for datatransmission to a separate tuner of the cable receiver, as isconventionally used for services such as viewing authorization. Insatellite television applications, it is preferable to provide themetadata by in band multiplexing.

[0067] The metadata for a given programming event is preferablytransmitted sufficiently in advance of corresponding programming eventsto allow time for processing of the metadata by client devices. However,it may be desirable to limit the amount of advance time where clientmetadata storage capacity is limited. For example, in the case ofprograms having a large number of constituent programming events, suchas news programs, it may be preferable to send metadata no more than onehour in advance of the program.

[0068] Processing occurring in the production facility agent of FIG. 5is described in FIG. 6. In accordance with FIG. 6, the productionfacility agent provides production data for a program to a metadatagenerator (40). The production data typically includes descriptiveinformation that is associated with timing information, such as the dataillustrated in FIGS. 3 and 4. The production facility agent thenreceives metadata for individual programming events within the program(42). The production facility agent then provides the metadata fortransmission through a programming event transmission system (44). Themetadata may encoded using an encoding standard such as described above.

[0069]FIG. 7 shows an example of a logical organization of metadata fora programming event in accordance with preferred embodiments of theinvention. The illustrated metadata describes a segment of a local newsbroadcast relating to an NFL team. The metadata is comprised ofdelimited descriptive data associated with fields of a generic metadataformat. A Program_ID field provides a unique identifier for eachprogramming event. A Program_Name field provides the name of the programwith which the programming event is associated. A Program_Descriptionfield provides a description of the programming event, and aProgram_Reduced_Description field provides a shortened description or“gist” of the programming event. Fields for Program_Date,Program_Start_Time and Program_Duration provide information identifyingwhen and for how long the programming event is aired. A Channel_ID fieldidentifies the channel on which the programming event will be received.A Program_Type field describes the type of programming event, such as aprogram, a program segment, or a movie. Program_TV_Rating andProgram_MPAA_Rating fields provide ratings assigned to the program byrating services. A Message_Status field indicates whether theprogramming event is a first transmission, a retransmission, or anupdated transmission. A Category_List field provides goodness of fitscores for the programming event with respect to categories in aclassification hierarchy as described further below. A Keyword_Listfield contains keywords describing the subject matter of the programmingevent and may further contain goodness of fit scores for each keyword.The metadata is preferably formatted in a standard delimited format, forexample, as an XML document using appropriate tags.

[0070] The classification hierarchy with respect to which theprogramming event is scored comprises a hierarchy of subject categories.FIG. 8 illustrates a portion of an exemplary classification hierarchy inaccordance with embodiments of the invention. At the top level of thehierarchy are general subject categories such as Sports, Entertainment,News, etc. Extending from each of the top level categories is a tree ofmore specific subject categories that fall within the top levelcategory. FIG. 8 particularly illustrates a branch within the hierarchyin which Football is one of several categories within Sports, NFL is oneof several categories within Football, AFC is one of several categorieswithin NFL, and Buffalo Bills is one of several categories within AFC.

[0071] In the classification hierarchy of FIG. 8, the categories areshown as being organized in common ordinal levels, such that allcategories at the top level of the hierarchy are at Level 1, allcategories depending from Level 1 categories are at Level 2, and soforth. Embodiments of the invention may treat the common ordinal levelof a category as being representative of that category's specificityrelative to other categories of the classification hierarchy. However,since the degree of specificity of categories at a given ordinal levelmay vary among branches of the hierarchy, alternative embodiments mayrepresent specificity in other manners. For example, each category maybe assigned individual specificity scores, or all categories dependingfrom a given category in the hierarchy may be commonly assigned aparticular specificity score.

[0072] In accordance with preferred embodiments of the invention,metadata generators such as those of FIGS. 1 and 5 produce metadata suchas shown in FIG. 7 by processing descriptive data concerning a givenprogramming event to classify the subject of the programming event usinga classification hierarchy such as the one shown in FIG. 8. An exampleof processing performed by a metadata generator to produce metadata fora programming event in accordance with an embodiment of the invention isillustrated in FIG. 9. Initially, the metadata generator receives datafor analysis that relates to a programming event (50). The received datamay include PDD data and production data. Where the received data isproduction data, that data is preferably processed by a standardizationagent that converts the production data to a standard delimited formatfor further processing. The data may also be parsed to determineindividual programming events within a program. The data is thenanalyzed and a goodness of fit score for the programming event isassigned with respect to each category of the classification hierarchy(52). A goodness of fit score indicates how well the particular categorydescribes the subject matter of the programming event. Goodness of fitscores may be generated using an appropriately configured classificationapplication. For example, the InterMedia media searching tool producedby Oracle Corporation, or the K2 classification tool produced by VerityCorporation, may be configured to define a thesaurus reflecting words,phrases and concepts associated with the categories of theclassification hierarchy, such that PDD and production data for aprogramming event may be searched with respect to each category of thehierarchy to generate a list of matched categories with associatedconfidence scores in a range from 1% to 100%. The confidence score foreach matched category is used as that category's goodness of fit score,and categories having no match are treated as having goodness of fitscores of zero.

[0073] After assigning goodness of fit scores (52), the metadatagenerator determines a set of categories within the hierarchy that arerepresentative of the programming event (54). In the preferredembodiment, the metadata generator first determines for each branch ofthe classification hierarchy the most specific category that hasnon-zero goodness of fit score. For example, referring to theclassification hierarchy of FIG. 8, if the category Buffalo Bills isassigned a goodness of fit score of 75%, the higher level categories inits branch will also have non-zero goodness of fit scores; however,Buffalo Bills is the most specific category having a non-zero score inits particular branch of the hierarchy. The metadata generator thendetermines additional representative categories by examining thedifferences in the goodness of fit scores of the most specificcategories and their parent categories. In preferred embodiments, theparent category of a most specific category is determined to be anadditional representative category if the difference between its scoreand the most specific category exceeds a predetermined amount orpercentage. Determination of such parent categories serves to identifyinstances in which it is desirable to supplement or qualify therepresentative information conveyed by the score of a most specificcategory. It may also be preferable to limit the number of categoriesper programming event by defining a maximum number of categories perprogramming event and utilizing the categories with the highest scoresconsistent with that maximum number. It may further be preferable toutilize a score thresholding procedure whereby a minimum goodness of fitscore is required for a category to be included in the metadata.

[0074] Once determined, the identifiers and associated goodness of fitscores of the representative categories are stored in delimited fashion(56). Other data is also generated through processing of the PDD andproduction data and is stored together with the goodness of fit scoresin delimited fashion to comprise metadata for the programming event. Theother data referred to here may comprise data such as is shown in theexemplary metadata of FIG. 7, such as description, time, duration,keywords, etc. Like categories, keywords may be assigned goodness of fitscores using a classification application. A variety of storage formatsare available for storing the metadata. For example, the metadata may bestored as an XML document using appropriate tags for indicating thevarious types of data within the metadata.

[0075] In further preferred embodiments, the metadata generator mayadditionally provide automatic generation of keywords. Keywords arepreferably generated through analysis of descriptive data included inany production data and PDD data that is available for the programmingevent. In one preferred embodiment, all text data associated with theprogramming event such as script data and PDD data is processed toidentify all verbs and all nouns and associated adjectives containedtherein. These candidate keywords are then provided as input to thecategorization tool, which produces a goodness of fit score for eachcategory of the classification hierarchy based on each input candidatekeyword. Keywords are then chosen from among the candidate keywordsbased on the highest goodness of fit score associated with eachcandidate. To provide further precision, the category goodness of fitscores for each candidate keyword may be correlated with the categorygoodness of fit scores for the programming event as a whole, so thatcandidates having high goodness of fit scores for categories that arenot relevant to the programming event as a whole are not chosen askeywords. The highest category goodness of fit score for each chosenkeyword may be adopted as a goodness of fit score for the keyworditself.

[0076] In one alternative to the aforementioned preferred embodiment,processing of the descriptive data to determine nouns and verbs may beeliminated and all words from available script data may be provided ascandidate keyword inputs to the classification tool. In this alternativeembodiment it is preferred to correlate the resulting category scores ofeach candidate keyword with the category scores of the programming eventas a whole.

[0077] A process encompassing the aforementioned preferred embodiment,its suggested alternatives and other alternative implementations isillustrated in FIG. 10. As shown in FIG. 10, candidate keywords aredetermined (220) from descriptive data associated with a programmingevent. The candidate keywords are provided (222) as input to aclassification tool configured to generate goodness of fit scores forcategories of a classification hierarchy. Keywords are then selected(224) from among the candidate keywords based on the category goodnessof fit scores generated for each of the candidate keywords by theclassification tool. The selected keywords are then stored (226) as acomponent of metadata for the programming event.

[0078] In a further preferred embodiment, the metadata generator mayadditionally provide automatic generation of titles for programmingevents. This embodiment is particularly preferred for applications inwhich the programming event comprises a segment of a larger program, forexample, an individual segment of a news program. In accordance with thepreferred embodiment, the metadata generator generates a title for theprogramming event through analysis of the production data. For example,the title may comprise the name of the category having the highestgoodness of fit score in the metadata, combined with one or more of thehighest scoring keywords. Alternatively, the classification tool thatgenerates category goodness of fit scores may be further configured toproduce a summary of the programming event using the descriptive data.In further alternatives, a most descriptive noun, action word, or phrasemay be selected from the descriptive data.

[0079] As an enhancement to the aforementioned embodiments, a furtherpreferred embodiment may implement an interactive process whereby aproducer of a programming event is enabled to select or specifycategories, keywords, and goodness of fit scores to be included in themetadata for the programming event. FIG. 11 shows process flow in asystem in accordance with this preferred embodiment. Initially thesystem generates (228) preliminary metadata for the programming event.The preliminary metadata is typically generated from production data andPDD data using a classification tool in the manner described herein, andtypically comprises categories and category goodness of fit scores,keywords and keyword goodness of fit scores, and a title. Thepreliminary metadata is then provided (230) to a system user, typicallya producer or other person involved with production of the programmingevent. The preliminary metadata is preferably provided using a graphicaluser interface that displays the various components of the preliminarymetadata and enables the system user to change the preliminary metadataor to add additional metadata. For example, the system user ispreferably enabled to delete a category, add a category, and add orchange a category goodness of fit score. Similarly, the system user ispreferably enabled to add or delete keywords, to change keyword goodnessof fit scores, and to edit titles and other descriptive components ofthe preliminary metadata. Thus by operation of the user interface, thesystem receives (232) specified metadata from the system user responsiveto the preliminary metadata. The specified metadata, or at least theportions of the metadata that were specified by the system user, arethen utilized by the metadata generator in preference to any conflictingmetadata that may be later generated by the classification application.In one alternative to these embodiments, the system user may simplyapprove the preliminary metadata provided by the system. This approvalmay be provided separately for the different metadata components such ascategories, category goodness of fit scores, keywords, keyword goodnessof fit scores, and title.

[0080] The aforementioned embodiments may be implemented in a variety ofmanners in accordance with the particular application. In oneimplementation, the user interface is generated by the productionfacility agent, while the preliminary metadata is generated by a remotemetadata generator with which the production facility agent interacts.The production facility agent may be implemented independently of otherapplications running on the production facility equipment, or it may beimplemented through macros or extensions associated with otherproduction equipment applications. Alternatively, the metadata generatormay be implemented locally as part of the production facility agent oras a separate agent running on the production facility equipment.

[0081] In further alternative embodiments it may be desirable forbusiness purposes to adjust the goodness of fit scores for particularprogramming events before they are stored in metadata. For example,goodness of fit scores may be raised so that that analysis of thegoodness of fit scores will be biased in favor of those programmingevents as compared to other programming events.

[0082] As described above with respect to FIGS. 1 and 5, metadata forprogramming events may be distributed to client devices, where it maythen be processed by a client device to automatically determineprogramming events that are desirable for viewing or storage. The clientdevice is preferably a video storage device that is used in associationwith a video display device such as a television for reception, displayand storage of video. However, embodiments of the invention may beimplemented in a variety of other types of client devices including settop boxes, personal computers, video display devices such astelevisions, wireless communication devices, and personal digitalassistants.

[0083] Client devices in accordance with embodiments of the inventionare comprised of a data processing device that includes a processor orprocessors and memory storing one or more viewer profiles, receivedmetadata, and programming instructions that instantiate a client agentthat processes metadata to determine programming events that aredesirable for viewing or storage in accordance with the viewer profiles.FIG. 12 shows a client device in accordance with a preferred embodimentof the invention. In this preferred embodiment, the client devicereceives video signals from a broadcast, cable or satellite televisionprovider, data network, or other video source, and receives metadatafrom a distinct metadata distributor such as an internet server. Theclient device includes a video receiver 60 for receiving anddemodulating signals representing programming events 62. Typically thevideo receiver is a device for demodulating analog or digital videosignals. The client device further includes a metadata receiver 64 forreceiving metadata 66. Typically the metadata receiver is a device thatis capable of communicating with a network for downloading metadatafiles to the client device. For example, the metadata receiver may be amodem that is programmed to periodically access a remote server wheremetadata is stored. The client device further comprises a data processor68 such as a microprocessor, a data storage device 70 such as a RAM orROM or a combination of the two, and a bulk data storage device 72 suchas hard disk storage or optical disk storage. A display interface 74generates audio and video signals 78 for use by a display device such asa television. The video receiver 60, metadata receiver 64, dataprocessor 68, data storage 70, bulk data storage 72, and displayinterface 74 are coupled through a bus 76.

[0084] As noted above, it is assumed for the preferred embodiment shownin FIG. 12 that the client device receives video signals from abroadcast, cable or satellite television provider, or data network andreceives metadata from a distinct metadata distributor such as a dial-upserver, and therefore has separate video and metadata receivers.However, in alternative embodiments, both the metadata and programmingevents may be received by a single receiver. For example, metadata maybe transmitted in broadcast provided through broadcast or cabletelevision channels, or may be provided in a text band of a digitalvideo signal such as is provided in the MPEG-2 digital video standard.Alternatively, video and metadata may be provided from a common sourcethrough a common transmission medium, but received by separate receiversin the client device, as is the case in preferred cable televisionreceiver embodiments.

[0085] Client devices in accordance with preferred embodiments of theinvention provide standard PDD information and standard tools such as aprogram grid and keyword searching to allow users to manually identifyprograms for viewing or recording. In addition, client devices inaccordance with preferred embodiments of the invention analyze metadatato determine desirable upcoming programming events, and mayautomatically record these programming events, alert the viewer to theseprogramming events, or automatically display these programming events.The desirability of a programming event is determined with respect toviewer preferences represented in one or more viewer profiles stored inthe client device. An example of a viewer profile in accordance withpreferred embodiments of the invention is provided in FIG. 13. In thisviewer profile, a Profile_ID field provides a unique identifier for theprofile. A Profile_Name field provides a name for the profile as it willbe known to viewers. A Profile_Description field provides a longerdescription that may be used to provide more detail about the types ofprograms that the profile is intended to identify. A Profile_Priorityfield provides a number that indicates the priority of the profilerelative to other profiles stored in the client device. AProfile_Alerts_Per_Hour field provides a number of times per hour thatan alert is provided to the viewer indicating that a program providing abetter fit than the one being viewed is currently available for viewing.A Profile_Alert_Minutes_In_Advance field specifies an amount of timeprior to a programming event that a viewer is to be notified of aprogramming event. A Profile_Activation_Time indicates a time frameduring which the profile should be used for analyzing programs. ACategory_Scores field contains an identifier and associated preferencescore for categories in a classification hierarchy for which apreference score has been specified. The preference scores represent arelative degree of interest in each category that may be used inprocessing of metadata to determine the relative desirability ofprogramming events using their category goodness of fit scores. In thepreferred embodiment, a preference score of ten indicates the highestlevel of preference. A Keyword_List field contains keywords that reflectthe viewer's viewing tastes. A keyword may be associated with a categoryof the classification hierarchy, indicating that the keyword reflectsthe viewer's viewing tastes specifically with regard to subject matterfalling within that category. For example, in FIG. 13, the keyword“Bills” is associated with the category Sports/Football/NFL. Suchkeywords are referred to herein as qualified keywords. Qualifiedkeywords allow the viewer to effectively define a subset of subjectmatter within a category that is of particular interest. Keywords mayalso be assigned preference scores, as shown in FIG. 12. As withcategories, keyword preference score may be used in processing ofmetadata to determine the relative desirability of programming eventsusing keyword matching. A variety of storage formats are available forstoring the viewer profile. For example, the viewer profile may bestored as an XML document using appropriate tags for indicating thevarious types of data within the viewer profile.

[0086] The client device is preferably provided with generic viewerprofiles that are tailored to different viewing interests such assports, political news, and other interests. The generic profiles may bepre-programmed in the client device or may be provided to the clientdevice by the metadata distributor. The user is preferably enabled tomodify or delete the pre-programmed viewer profiles and to configureadditional viewer profiles in accordance with particular viewing tastes.

[0087] Accordingly, the client device is provided with programminginstructions for providing an editor enabling the user to create andedit viewer profiles. The profile editor provides a graphical userinterface that includes tools enabling a user to enter the types ofinformation that may be included in a viewer profile such as the oneillustrated in FIG. 13. In particular, the viewer may enter informationsuch as the profile name, description and priority, alerts per hour orother period of time, alert minutes in advance or time in advance,profile activation time, and keywords. In addition, the viewer may enterscores for each category in the classification hierarchy, may associatekeywords with categories of the classification hierarchy as qualifiedkeywords, and may associate preference scores with keywords andqualified keywords. The user interface preferably allows the user tonavigate through the classification hierarchy structure and to enterscores for categories as desired. When a preference score is entered fora given category, that preference score is preferably assigned to allsubcategories of the given category. In other words, all categories thatbranch from the given category are assigned the same preference score asthe given category. Therefore, if a category is given a preference scoreof ten, all of its subcategories will likewise be given a preferencescore of ten. Similarly, if a category is given a preference score ofzero, all of its subcategories are likewise given a score of zero. Ofcourse, the scores for those subcategories can later be changedindividually.

[0088] Viewer profiles may be used in processing metadata to build aschedule of desirable programming events that may be automaticallyrecorded, recommended for viewing, or switched to automatically. Aschedule building process in a client device in accordance withpreferred embodiments is illustrated in FIG. 14. This process assumesthat metadata for various programming events becomes availablesporadically, and the process therefore involves periodic updating toaccount for any newly available metadata. Initially, all availablemetadata for upcoming programming events is received (100). The metadatamay be received by connecting to a server and downloading new metadata.Alternatively, metadata may be continuously received through thebroadcast system that provides programming events. The metadata is thenprocessed in accordance with one or more viewer profiles to assigndesirability scores to each programming event (102). The scores of theprogramming events along with their times and durations are thenprocessed to determine a preferred programming event schedule (104). Inthe case of a recording schedule in a device capable of recording onlyone programming event at a time schedule reflects the most desirablenon-overlapping available programming events. In contrast, in the caseof an alert schedule, the programming events may overlap, since theviewer can decide which programming events to watch. In each instance,the client device preferably stores at least the programming eventtitle, time, duration, and category, and the viewer profile or profilesthat resulted in its selection. Generation of the schedule may include athresholding function whereby a programming event must achieve a minimumdesirability score in order to be included in the schedule. Otherfunctions, such as filtering out programming events that have alreadybeen recorded or viewed, may also be performed. After the schedule isdetermined, a periodic updating of the schedule is performed.Particularly, after a given time interval, additional metadata isreceived (106). The additional metadata typically corresponds toprogramming events for which no metadata was previously received, butupdated metadata may also be received. The additional metadata isprocessed to determine desirability scores for corresponding programmingevents (108). The scores, times and durations for those programmingevents are then processed to determine any updates to the preferredprogramming event schedule (110). An alert list may be updated whenevera new programming event score is determined to be higher than onealready stored in the schedule. A recording schedule may be updated whena new programming event score is determined to be higher than anotherprogramming event in the same time slot that is already stored in theschedule, or when a new programming event with a sufficiently high scoreoccurs in a time slot for which there is no programming event listed inthe schedule. After determining any updates, the updates are stored inthe preferred programming event schedule (112). The updating process isthen repeated at intervals.

[0089] Since metadata is assumed to arrive sporadically and may arriveonly shortly prior to the time of its corresponding programming event,it is preferable to prioritize the processing of available metadata onthe basis of the time remaining until the beginning of the correspondingprogramming event. This may be determined through reference to time datacontained within the metadata.

[0090] In conjunction with the scheduling process, the viewer ispreferably notified each time a programming event is added to theschedule, and enabled to approve or decline each programming event. Thismay be accomplished by displaying an icon that may be operated by theviewer to display information about a newly scheduled programming event.Scheduled programming events that have been explicitly approved by theviewer may be treated in the updating process as having a highestpossible desirability score, irrespective of the actual score, such thatconflicting programming events that have higher scores but were notidentified prior to the viewer's approval cannot be substituted in theschedule without explicit viewer approval. In further preferredembodiments of the invention, the user is enabled to manually edit thepreferred programming event schedule and to manually scheduleprogramming events for recording. Like viewer-approved programmingevents, manually scheduled programming events are given priority overlater-identified preferred programming events.

[0091] In preferred embodiments of the invention, the preferredprogramming event schedule may be used by the client agent to providealerts concerning programming events to a real time viewer, or toautomatically record programming events when no real time viewer ispresent. A control process performed by the client agent in accordancewith preferred embodiments of the invention is shown in FIG. 15. In theillustrated process, it is assumed that the client device includes twoRF tuners enabling a real time viewer to receive a first channel forviewing while a second channel may also be received for recording.Initially, the client agent checks the schedule to determine a nextupcoming preferred programming event (120). The client agent thendetermines whether a real time viewer is present (122). If no viewer ispresent, the preferred programming event is recorded (124), for example,by storage in the bulk data storage device as illustrated in FIG. 12.Alternatively, if there is a real time viewer, the viewer is providedwith an alert for the upcoming preferred programming event (126). Alertsmay be provided in various manners, such as by generating an audibletone or displaying a banner on the video display device. The time of thenotification may be determined with reference to the value in theProfile_Alert_Minutes_In_Advance field of a viewer profile as shown inFIG. 13. If the viewer selects the preferred programming event forviewing (128), the preferred programming event is automaticallydisplayed as soon as it is available for viewing (130). On the otherhand, if the viewer does not select the preferred programming event forviewing, the preferred programming event is recorded (124). Inalternative embodiments where the client device includes only one RFtuner, the decision by a real time viewer not to view something otherthan the preferred programming event causes the recording of thepreferred programming event to abort. Newly recorded programs arepreferably identified in a notification list that may be accessed by theviewer. The notification list may be cleared after each access by theviewer.

[0092] Recorded programming events are preferably indicated in arecorded program list from which the user is enabled to select recordedprogramming events for viewing. Information stored in association witheach programming event in the recorded program list preferably includesthe time and date of the programming event, the programming event score,the profile that selected the programming event for recording, and thecategory of the programming event. A user is preferably enabled to sortthe recorded program list in accordance with any of these categories ofinformation. The device also preferably provides the option of seamlessreplay of the recorded programming events in an order chosen inaccordance with one of the above categories of information.

[0093] In one preferred embodiment of the invention, the client devicecomprises a set top box such as a cable box. The set top box analyzesmetadata and generates a schedule of programming events that matchviewer preferences. The set top box further provides on-screen alerts inadvance of each programming event in the schedule. The on-screen alertis preferably available in multiple styles that may be chosen by theuser, such as an icon or an information banner. The banner may containinformation such as the programming event title, a description, anindication of categories or keywords matched, and the channel number oridentifier. A particular category matched, or the fact of a keywordmatch, may be indicated by an icon displayed within the alert banner. Inone preferred embodiment, the banner includes the matched categorygenerating the highest match score, the matched keyword generating thehighest match score, and the associated scores. The banner is alsopreferably provided in different colors that correspond to the viewerprofile that generated the alert. The user is preferably enabled toconfigure the default amount of time that the alert is displayed, toclear the alert from the screen, and to switch to the programming eventof the alert automatically. The user is also preferably enabled to viewthe alert list and to delete programming events from the alert list.

[0094] The alert list is preferably viewable by the viewer, andpreferably allows the viewer to delete programming events from the alertlist, and to confirm interest in programming events in the alert list sothat subsequently analyzed programming events with higher scores do notcause those programming events to be bumped from the list. The alertlist is preferably generated in a manner that provides a maximum numberof alerts within a given time period, such as a fixed number of alertsper hour. This parameter may be configured as part of a viewer profile,as shown in FIG. 13. The alert list preferably highlights anyprogramming events in the list that are currently showing. The alertlist is preferably limited to those channels that the client device iscapable of receiving.

[0095] As noted above, the client device may determine preferredprogramming events with respect to one or more viewer profiles. In thecase where alerts are provided, it is preferable that the viewerprofiles used by the client device to identify programming eventscorrespond to the preferences of the actual real time viewers.Accordingly, the client device may enable a real-time viewer to specifyone or more viewer profiles to be used for generating alerts during theviewer's viewing session. For example, the viewer may select aparticular viewing profile tailored to his tastes while excludingprofiles of other viewers who are not present, or the viewer may selecta group viewer profile that reflects the collective tastes of presentviewers. In alternative embodiments, upon detection of a real timeviewer, such as by detecting activation of the video display device orchanging of channels, such profiles may be automatically selected by theclient device based on indicators of the current real time viewer suchas channel selection patterns. In view of these considerations,embodiments that provide both real time viewer alerts and automaticrecording may preferably maintain a first preferred programming schedulefor recording purposes based on the full set of viewer profilesmaintained by the client device, and may further generate a secondpreferred programming schedule in accordance with profiles specific tothe real time viewer as described above for purposes of providingalerts. In such embodiments, conflicts between the two programmingschedules are resolved in favor of the real time viewer where only asingle receiver is available.

[0096] The task of determining desirability scores for programmingevents is performed using the metadata for a programming event and oneor more viewer profiles stored in the client device. In preferredembodiments of the invention, scores are determined in a manner thatgives preference to keyword matches over category matches. Thus, forexample, where a viewer's keyword matches a keyword contained in thekeyword field of the metadata, or matches a word contained in thedescription field of the metadata, that programming event may beassigned the maximum preference score irrespective of any preferencescore generated using the programming event's category goodness of fitscores. Further scoring methods using a combination of keyword andcategory matching are described below.

[0097] A process for determining a desirability score for a programmingevent based on metadata category goodness of fit scores and viewerprofile category preference scores in accordance with a preferredembodiment of the invention is shown in FIG. 16. Referring to theleft-hand column of FIG. 16, the process first determines each categoryof the classification hierarchy that has a goodness of fit score in themetadata and that is assigned a preference score in the viewer profile(140). These categories are referred to herein as matched categories.For purposes of this determination, a category having a preference scorethat is equal to zero or less than a threshold minimum score may betreated as not having a preference score, and thus the category will notbe considered a matched category. For each matched category, a score isdetermined (142). The score is a function of the goodness of fit scoreof the matched category and the preference score of the matchedcategory. The score may be weighted in accordance with the specificityof the matched category so that the score increases with the specificityof the matched category. After scores for each matched category aredetermined, the highest score and the category generating the highestscore are adopted as the desirability score and category of theprogramming event (144).

[0098] The function and weighting scheme for generating scores may beimplemented in a variety of manner. For example, in an implementation inwhich the categories of the classification hierarchy are assignedindividual specificity weights that increase with the specificity of thecategory, the score may be calculated as a function of the goodness offit score, the preference score, and the specificity weight of thematched category. In this manner, the score is influenced by thepreference encoded by the viewer in the profile for the matchedcategory, the degree to which the programming event is described by thematched category, and the specificity with which the matched categorydescribes the subject matter of the programming event.

[0099] In accordance with a preferred embodiment of the invention, ascore is calculated as illustrated in the right-hand column of FIG. 16.In this preferred embodiment, the categories of the classificationhierarchy are arranged in common ordinal levels, and the level of acategory is taken as being representative of its specificity. Thus, inaccordance with the preferred embodiment of FIG. 16, the score for agiven matched category is calculated by first weighting the preferencescore of each category in the branch terminating with the matchedcategory by a factor that is based on the level of the category (146).In the preferred embodiment, this weight is calculated as the quantitye^(N−i), where N is the number of ordinal levels in the classificationhierarchy and i is the ordinal level of that particular category. Theweighted preference scores for all of the categories in the branch arethen summed, and the sum is multiplied by the goodness of fit score ofthe matched category (148). This sum is then weighted in accordance withthe duration of the programming event (150), for example, by multiplyingthe score by 10,000 and adding the duration in seconds of theprogramming event. Weighting of the score by the program duration servesto resolve conflicts among overlapping programming events that wouldotherwise have identical scores. The score for each matched category istherefore calculated as:$\left( {10^{4}*S*{\sum\limits_{i = 1}^{N}\quad {{P\left( V_{i} \right)}*^{N - i}}}} \right) + d$

[0100] where:

[0101] N=the number of ordinal levels in the classification hierarchy

[0102] V_(i)=a category in the branch of the matched category at level iof the hierarchy

[0103] P(V_(i))=the preference score of category V_(i) in the viewerprofile

[0104] S=the goodness of fit score of the matched category

[0105] d=the duration of the programming event in seconds

[0106] In further preferred embodiments, the category preference scoresof multiple viewer profiles may be used for determining desirabilityscores for programming events. A process for determining a desirabilityscore for programming events in accordance with a preferred embodimentis shown in FIG. 17. This embodiment is particularly preferred forgenerating scores to be used in determining a recording schedule thataccounts for the combined preferences expressed in more than one viewerprofile. Referring to the left-hand column of FIG. 17, the process firstdetermines each category that has a goodness of fit score in themetadata and that is assigned a preference score in a viewer profile(160). These again are referred to as matched categories, and may omitany categories having a preference score less than a certain minimumvalue. For each matched category, a score is determined (162). The scoreis a function of the goodness of fit score of the matched category, thepreference score assigned to the matched category in each viewerprofile, and a priority of each viewer profile. The score may beweighted in accordance with the specificity of the matched category sothat the score increases with the specificity of the matched category.After scores for each matched category are determined, the highest scoreand the category generating the highest score are adopted as thedesirability score and category of the programming event (164).

[0107] The function and weighting scheme for generating scores may beimplemented in a variety of manner. For example, in an implementation inwhich the categories of the classification hierarchy are assignedindividual specificity weights that increase with the specificity of thecategory, the score may be calculated as the sum of quantitiescalculated for each profile, where that quantity is the product of thegoodness of fit score, the preference score, a quantity proportional tothe priority of the viewer profile, and the specificity weight of thematched category. In this manner, the score is influenced by thepreference encoded by the viewer in each profile for the matchedcategory, the degree to which the programming event is described by thematched category, the priority of each profile that included a score forthe matched category, and the specificity with which the matchedcategory describes the subject matter of the programming event.

[0108] In accordance with a preferred embodiment of the invention, thescore is calculated as illustrated in the right-hand column of FIG. 17.In this preferred embodiment, the categories of the classificationhierarchy are arranged in common ordinal levels, and the level of acategory is taken as being representative of its specificity. Thus, inaccordance with the preferred embodiment of FIG. 17, the score for agiven matched category is calculated by first weighting the preferencescore of each category in the branch terminating with the matchedcategory by a factor that is based on the level of the category (166).This is done for each profile that includes a preference score for thematched category. In the preferred embodiment, this weight is calculatedas the quantity e^(N−i), where N is the number of ordinal levels in theclassification hierarchy and i is the ordinal level of that particularcategory. The weighted preference scores for all of the categories ineach branch are then summed for each profile, and these sums aremultiplied by the goodness of fit score of the matched category (168).Each of these products is then weighted in accordance with the priorityof its profile. In the preferred embodiment, a quantity P is associatedwith each priority, such that P is greater for higher priority. Theweight for a given profile j may then be calculated as the quantityP_(j) divided by the sum of all Ps corresponding to all profiles havinga preference score for the matched category. After priority weightingthe product for each profile (170), the priority weighted products aresummed together and multiplied by the number of profiles that include apreference score for the matched category (172). This sum is thenweighted in accordance with the duration of the programming event (174),for example, by multiplying the score by 10,000 and adding the durationin seconds of the programming event. The score for each matched categoryis therefore calculated as:$\frac{10^{4}*S*{I}*{\sum\limits_{j = 1}^{I}\quad {P_{j}\left( {\sum\limits_{i = 1}^{n}\quad {{P\left( V_{ij} \right)}*^{N - i}}} \right)}}}{\sum\limits_{j = 1}^{I}\quad P_{j}} + d$

[0109] where:

[0110] N=the number of ordinal levels in the classification hierarchy

[0111] V_(i)=a category in the branch of the matched category at level iof the hierarchy

[0112] P(V_(ij))=the preference score of category V_(i) in profile j

[0113] P(j)=a quantity representing the priority of Profile j

[0114] |I|=number of profiles that include a preference score for thematched category

[0115] S=the goodness of fit score of the matched category

[0116] d=the duration of the programming event in seconds

[0117] In contrast to the aforementioned multiple viewer profileembodiment, it is sometime preferable to calculate scores for viewerprofiles individually rather than in a combined manner as discussedabove. For example, for providing alert lists for multiple viewerprofiles, it is desirable to normalize the number of alerts generated byeach profile. Thus in such embodiments it is preferred to calculate thescores for each profile separately and allot a given number of alerts toeach profile.

[0118] In alternative preferred embodiments, desirability scores may bedetermined through a combination of keyword and category matching toproduce results that satisfy the viewer's preferences with greaterreliability. For purposes of describing these alternative embodiments,desirability scores determined based upon category matching as describedabove will be referred to as category match scores, while desirabilityscores based upon keyword matching will be referred to as keyword matchscores or qualified keyword match scores, as discussed further below.

[0119] In a first alternative preferred embodiment, simple keywordmatching may be employed in combination with category matching to rankprogramming events. In this alternative embodiment, a simple keywordmatch between a keyword of a viewer profile and a metadata keyword or aword included in descriptive data of the metadata produces a keywordmatch score. A keyword match preferably encompasses both exact matchesbetween keywords and matches between roots of keywords. The keywordmatch score assigned to a simple keyword match is preferably chosen tobe greater than a maximum category match score, so that any programmingevent having a keyword match is ranked higher than any programming eventnot having a keyword match. This reflects a presumption that aprogramming event matching a keyword provided by a viewer is more likelyto satisfy the viewer's preferences than a programming event matchingthe viewer's specified categories. Of course, alternatives to thepresent embodiment may implement different scoring reflecting differentpresumptions.

[0120] The keyword match score may be a constant that is assigned foreach keyword match. Alternatively, the keyword match score may be aconstant that is augmented by an additional quantity that is programmingevent dependent to thereby minimize the possibility of equal rankingresulting from more than one keyword match. For example, a constant usedas a basic keyword match score may be augmented by a quantity that isderived from the length of the programming event, or a preference scoreassociated with the keyword in the viewer profile that produced thekeyword match, or a category match score determined for the programmingevent using the category preference scores of the viewer profile thatproduced the keyword match.

[0121] A basic process in a client device encompassing the firstalternative preferred embodiment and various implementations thereof isillustrated in FIG. 18. Initially metadata is received (234). Themetadata describes programming events, and includes goodness of fitscores associated with categories of a classification hierarchy. Themetadata further includes at least one of descriptive data, such as isillustrated in the Program_Description and Program_Reduced_Descriptionfields of the metadata of FIG. 7, and keyword data, as illustrated inthe Keyword_List field of FIG. 7. After receiving metadata, theprogramming events are ranked (236) in accordance with viewerpreferences expressed in one or more viewer profiles. The viewerprofiles include preference scores associated with categories of theclassification hierarchy and one or more keywords. The ranking uses themetadata goodness of fit scores and the viewer profile categorypreference scores to determine category matches and uses the metadatadescriptive data and/or keyword data and the viewer profile keywords todetermine keyword matches.

[0122] In a second alternative preferred embodiment, qualified keywordmatching may be employed in combination with simple keyword matching andcategory matching to rank programming events. In this alternativeembodiment, a match between a qualified keyword of a viewer profile ametadata keyword or a word included in descriptive data of the metadataproduces a qualified keyword match score when the metadata includes agoodness of fit score for the category specified in the viewer profilefor the qualified keyword. A qualified keyword match preferablyencompasses both exact matches between keywords and matches betweenroots of keywords. The keyword match score assigned to a qualifiedkeyword match is preferably greater than a greatest possible simplekeyword match score, so that any programming event having a qualifiedkeyword match is ranked higher than any programming event having only asimple keyword and/or category match. This reflects a presumption that aprogramming event matching a qualified keyword provided by a viewer ismore likely to satisfy the viewer's preferences than a programming eventmatching a simple keyword or the viewer's specified categories. Ofcourse, alternatives to the present embodiment may implement differentscoring reflecting different presumptions.

[0123] The qualified keyword match score is preferably determined usinga constant that is assigned to each qualified keyword match and that isaugmented in each case by quantity that is determined using thepreference score associated with the category of the qualified keywordin the viewer profile of the qualified keyword. In this manner thequalified keyword matches are ranked relative to one another based onthe preferences for their associated categories expressed by the viewer.Alternative manners of ranking qualified keyword matches may also beemployed, for example, using a preference score associated with thequalified keyword in the viewer profile that produces the qualifiedkeyword match, or the length of the programming event, or a categorymatch score determined for the programming event using the categorypreference scores of the viewer profile that produces the qualifiedkeyword match, or the goodness of fit score of the qualified keyword'scategory in the programming event metadata.

[0124] A basic process in a client device encompassing the secondalternative preferred embodiment and various implementations thereof isillustrated in FIG. 19. Initially metadata is received (238). Themetadata describes programming events, and includes goodness of fitscores associated with categories of a classification hierarchy. Themetadata further includes at least one of descriptive data, such as isillustrated in the Program_Description and Program_Reduced_Descriptionfields of the metadata of FIG. 7, and keyword data, as illustrated inthe Keyword_List field of FIG. 7. After receiving metadata, theprogramming events are ranked (240) in accordance with viewerpreferences expressed in one or more viewer profiles. The viewerprofiles include preference scores associated with categories of theclassification hierarchy and one or more keywords. The keywords may bequalified keywords or simple keywords. The ranking uses the metadatagoodness of fit scores and the viewer profile category preference scoresto determine category matches and uses the metadata descriptive dataand/or keyword data and the viewer profile keywords and qualifiedkeywords to determine keyword matches.

[0125] In further alternative embodiments, the matching processing inthe client device may process qualified and simple keywords in a unifiedmanner by treating unqualified keywords as qualified keywords that areassociated with a super category of the classification hierarchy thatencompasses all other categories.

[0126] It is noted that in embodiments such as the various alternativepreferred embodiments described above, in which ranking is based onscores generated using two or more different types of matches, it ispossible for a viewer profile to generate more than one match score fora programming event. For example, a viewer profile may generate both akeyword match and a category match for the programming event. In suchembodiments, it is preferred to use the highest score for purposes ofranking. Alternatively, in further embodiments a single function ofcategory, keyword and qualified keyword matches may be employed togenerate a single score for each programming event.

[0127] In addition, it is preferable in the aforementioned preferredembodiments to apply thresholding processes that exclude keywords orcategories from match processing where preference scores or goodness offit scores are below a threshold value. For example, where the categoryof a qualified keyword has a goodness of fit score below a threshold fora given programming event, the qualified keyword may be excluded fromanalysis of that programming event.

[0128] The aforementioned systems and methods may be employed to providea client device that generates a preferred programming event list anduses that list to provide alerts or to record programming events. In oneembodiment of such systems, the timing of the alerts or recording may bedetermined with reference to time maintained by a client local clockusing timing information contained in programming event metadata, suchas a beginning time and duration, to determine the actual start time ofthe programming event. Client local clocks may be synchronized to aglobally available timing reference such as the time signal provided bythe Public Broadcasting System.

[0129] However, it may often be the case that timing informationcontained in programming event metadata does not represent the actuallocal clock time at which a programming event will begin. This may occurfor a variety of reasons. For example, different programming eventproviders such as television broadcasters may not be synchronized to thesame global timing reference. Thus, for example, the beginning of thenoon hour broadcast on one network may begin earlier or later than thatof another network by as much as a minute or more, and therefore theclient local clock may be synchronized to only one, or possibly toneither of the programming event providers. As a result, a recordingthat is commenced based on the local clock time may not fully capturethe desired programming event or may capture unwanted matter. Also, inmulti-segmented programs such as news broadcasts, the predicted timesand durations expressed in the metadata for each segment may not beadhered to during the actual broadcast, since the nature of suchprograms can be fluid with some segments running shorter or longer thanpredicted. Similarly, some programming events such as sporting eventsmay exceed their scheduled time, causing subsequent events to bedelayed.

[0130] Accordingly, it is desirable to provide timing references in thesignals of the individual programming event providers that may be usedby client devices to accurately determine the beginning and endingpoints of individual programming events. In accordance with onepreferred embodiment, the closed caption data stream is used to conveyprogramming event timing information to client devices. The EIA608Bstandard for analog closed caption data and the EIA708B standard fordigital closed caption data include protocols for “hidden” data that isnot reproduced on the viewer's display and that therefore may be usedfor signaling. Thus the closed caption data stream from a givenprogramming event provider may incorporate timing signals that are usedby client devices to accurately determine the beginning and ending timeof each programming event. In accordance with alternative embodiments,timing information may be included in the video signal itself. Forexample, in analog video signals the timing information may be includedin a vertical blanking interval. In digital video signals the timinginformation may be provided in a data field of the digital video signal.

[0131] In a first preferred embodiment, a closed caption data streamincludes a programming event identifier that is synchronized with thebeginning of the corresponding programming event. FIG. 20 shows anexample of a closed caption data stream in accordance with the preferredembodiment. In the closed caption data stream, text corresponding to aprogramming event designated as “PE 1 ” (programming event 1) precedestext corresponding to a following programming event designated as “PE 2”(programming event 2). Immediately prior to the text data for PE 2 is anidentifier for programming event 2. The identifier is preferably thesame identifier for programming event 2 that is used in metadata forprogramming event 2 previously supplied to client devices, and may beobtained through interaction with a local or remote metadata generator.However, other types of identifiers may be used so long as they can berecognized by client devices as relating to a particular programmingevent. The timing data is preferably accompanied by a marker thatidentifies it as timing data, and the timing data is preferablyencrypted.

[0132] As an alternative to the arrangement of timing data shown in FIG.20, timing data may be embedded in the closed caption data stream at alocation prior to the beginning of a programming event in order toafford sufficient set-up time for recording in the client device. Forexample, the timing data may be located at a fixed time prior tocommencement of the programming event, for example, five seconds beforethe programming event. Alternatively, the timing data may be located atan arbitrary time prior to the programming event and may includeinformation indicating the amount of time remaining before the beginningof the corresponding programming event.

[0133] As an enhancement to the aforementioned preferred embodiments,the closed caption data may also include timing data that corresponds tothe end of a programming event. As with the beginning timing data, theend timing data may comprise an identifier located at the end of theprogramming event, or at a fixed or specified time prior to the end ofthe programming event. The timing data indicating the end of theprogramming event may be timing data specifically defined as end pointidentifying timing data of the programming event being recorded, or itmay be timing data indicating the beginning of the next programmingevent. As a further enhancement, the closed caption timing data mayinclude timing data indicating beginnings and endings of individualsegments within a programming event. For example, where a programmingevent to be recorded is a television program that includes commercialbreaks, the closed caption timing data may indicate points at whichcommercial breaks begin and end so that a recording device can use thetiming data to exclude the commercial portions from recording, deletethe commercial portions subsequent to recording, or skip the commercialportions during playback.

[0134] Thus in accordance with preferred embodiments of the invention, aprocess for producing closed caption data including programming eventtiming data of the types described above or other alternative types maybe implemented in a video production facility to produce closed captiondata including timing data at the time of production of the videoprogram. Generally, script data is received for a video program.Identifiers of individual programming events within the program are thendetermined. This may be done using the script data and other productiondata in a metadata generation process such as the metadata generationprocesses described above. Closed caption data is then produced for theprogram. The closed caption data includes text data corresponding to thescript data, and timing data. The timing data is provided at locationswithin the closed caption data that correspond to the beginnings of eachprogramming event within the program, and the timing data for eachprogramming event includes the identifier of that programming event.Additional closed caption timing data may also be provided at locationscorresponding to the ends of programming events and to the beginningsand endings of segments within programming events. The producer mayfurther provide synchronized transmission of the closed caption data andprogramming events, or may store the programming events and closedcaption data on a machine readable storage medium.

[0135] In accordance with alternative embodiments of the invention, aprocess for producing a video signal including programming event timingdata of the types described above or other alternative types may beimplemented in a video production facility to produce a video signalincluding timing data at the time of production of the video program.Generally, the beginnings of programming events within the program andidentifiers of each programming event are determined. This may be doneusing script data and other production data in a metadata generationprocess such as the metadata generation processes described above. Avideo signal is then produced for the program. The video signal includestiming data that is provided at locations within the video signal atlocations that correspond to the beginnings of each programming eventwithin the program, and the timing data for each programming eventincludes the identifier of that programming event. Additional timingdata may also be provided at locations corresponding to the ends ofprogramming events and to the beginnings and endings of segments withinprogramming events.

[0136] In a further embodiment, the production of closed caption timingdata is implemented in a manner that is preferred for providing enhancedsynchronization for video programs, and particularly for “live” videoprograms and other programs produced using a teleprompter. In such videoprograms, the exact timing of transitions between programming eventswithin the program can depends on the rate at which narration withineach programming event occurs. For example, the length of segments of anews program depends on the rate at which a news anchor reads the textof each segment. FIG. 21 illustrates basic components of a videoproduction system in accordance with preferred embodiments for enhancingsynchronization with client devices. The video production systemincludes a video source 242 for providing the program video signal 244.The system further includes a closed caption data source 246 forproviding a closed caption data stream 248 including closed caption textdata and timing data such as the timing data described above. The closedcaption data and video signal are provided to a storage device or atransmission medium 250. In addition, the system includes a telepromptersystem 252 that displays text to be read during the production of thevideo program, such as by news anchors or actors. The teleprompter textis generally prepared in advance of the program and in typicalimplementations the teleprompter text and the closed caption text areprepared from the same source and are therefore identical or verysimilar. The teleprompter displays text in a scrolling fashion that isregulated in accordance with the rate at which the text is being read.Thus in typical teleprompter system implementations the scrolling of theteleprompter text is used to trigger corresponding portions of theclosed caption text data, thereby producing a high degree ofsynchronization between the audio portion of the program and thecorresponding closed caption text data. In accordance with preferredembodiments of the invention as illustrated in FIG. 21, the closedcaption data source provides text 254 for display by the telepromptersystem 252, and the teleprompter system 252 provides a trigger signal256 to trigger the transmission of portions of closed caption data thatincludes timing data such as the various types of timing data describedabove. This provides a high degree of synchronization between the timingdata and transitions between programming events.

[0137] Thus in accordance with preferred embodiments of the invention, aprocess for generating closed caption data for a video program generallyinvolves producing closed caption data comprising timing data and textdata and producing a video signal for the video program. The locationsof timing data within the closed caption data may correspond tobeginnings or endings of programming events within the video program,and the closed caption data is synchronized to the video signal inaccordance with the display of corresponding data by a telepromptersystem used in producing the video program. The synchronized videosignal and closed caption data may be transmitted to client videoreception devices or stored on a machine readable storage medium.

[0138] The closed caption timing data described above may be used inclient video devices for synchronizing recording of programming eventsto the reception of those programming events. Typically, the timing datarepresented in programming event metadata is used for determining apreferred programming event list, while the closed caption data streamis monitored for a period prior to the anticipated commencement of aprogramming event to detect closed caption timing data signifying theactual beginning of the programming event. The closed caption datastream may also be monitored during reception of the programming eventto detect further timing data signifying an end point of the programmingevent or points at which recording should be paused or reinitiated afterpausing. A process for selectively recording programming events asillustrated in FIG. 22 may therefore be implemented in a video recordingdevice. Initially a programming event to be recorded is determined(258). The programming event to be recorded may be determined from arecording schedule based on the current time maintained by the recordingdevice. Timing data associated with the programming event is thenidentified (260) in a closed caption data stream received by therecording device. In some instances it may be necessary for therecording device to tune to the channel of the programming event inadvance of the beginning of the programming event in order to receivethe closed caption data stream of that channel so that the timinginformation indicating the beginning of the programming event may bedetected. The recording device may then control (262) recording of theprogramming event in accordance with the timing data. Such control mayinclude initiating recording, pausing recording, reinitiating recordingafter pausing, or terminating recording.

[0139] In alternative embodiments, timing data incorporated directlyinto the video signal as described above may be used in a similar mannerin a recording device by detecting the timing data within the videosignal rather than within closed caption data.

[0140] Where the timing data comprises a simple identifier located atthe beginning of the programming event, delays in commencing recordingupon receipt of the timing data may be resolved through buffering of thevideo stream in the client device. Such delays may be avoided throughthe use of timing data that is located prior to the beginning of theprogramming event by a predetermined or specified distance as describedabove.

[0141] Alternative embodiments of the invention may employ differentmethods of using closed caption timing data or timing data providedwithin the video to synchronize recording to programming eventtransmission. For example, a recording device may begin recording thechannel of a programming event in advance of the beginning of theprogramming event, and subsequently delete material recorded prior tothe beginning of the programming event indicated by the correspondingtiming data. Material recorded after the end of the programming event orduring commercial breaks or other segments indicated by the timing datamay be determined and deleted in a similar fashion.

[0142] In still further embodiments, timing data as described above maysimply be recorded in the closed caption data stream accompanying theprogramming event or in the video signal itself, and used later by thedevice to control playback, such as by beginning playback in accordancewith timing data indicating the beginning of the programming event,skipping portions such as commercial breaks indicated by the timingdata, and ending playback in accordance with timing data indicating theend of the programming event.

[0143] In still further embodiments, additional information mayaccompany the timing information in the closed caption data or videosignal.

[0144] Although the scoring and scheduling processes described above arepresented in the context of a client device that analyzes metadata forpurposes of identifying upcoming programming events to be recommended orrecorded, alternative embodiments of the invention may implement thescoring and scheduling processes in a server of a programming eventdistribution system that analyzes programming events to determineprogramming events of interest to particular viewers so that thoseprogramming events can be recommended for transmission or automaticallytransmitted. Such a system is illustrated in FIG. 23, in which ametadata distributor 180 supplies metadata 182 to a programming eventprovider 184, which in turn supplies preferred programming events 186 toa client device 188. In embodiments of this system, the client devicemay be a set top box, a computer, or a television. The programming eventprovider may be a broadcast, cable, or satellite television providersystem, or an internet server or video server. The programming eventprovider is typically implemented as a computing device including aprocessor or processors to execute programming instructions and memorycoupled to the processor(s) and containing programming instructions forinstantiating a programming event provider system providing programmingevent scoring and transmission as described further below.

[0145] The programming event provider system may perform scoring orscheduling processes as described above to assign scores to programmingevents using programming event metadata and viewer profiles provided byone or more consumers. For example, as shown in FIG. 24, the programmingevent provider may receive one or more viewer profiles from viewers(190). The viewer profiles may be provided, for example, by clientdevices. As described above, the viewer profiles include preferencescores associated with categories of a classification hierarchy. Theprogramming event provider also receives metadata for one or moreprogramming events (192). As described above, the metadata includesgoodness of fit scores for categories of the classification hierarchy.Metadata for programming events is processed using the viewer profilesto determine preferred programming events (194). In various embodiments,the metadata may be processed using a single viewer profile to determinepreferred programming events for one viewer or a groups of viewers, orthe metadata may be processed using multiple viewer profiles todetermine preferred programming events for a group of viewers. Preferredprogramming events are then transmitted to the one or more viewers(196). Transmissions may be provided in accordance with a preferredprogramming event schedule as described above. Alternatively, an indexof preferred programming events may be made accessible to viewer toallow viewers to select programming events for transmission.

[0146] Further alternative embodiments of the invention may implement aprogramming event scoring process in a server that analyzes programmingevents to determine programming events of particular interest to aviewer and provides alerts regarding the programming events to theviewer through a communication device such as a pager, email, instantmessaging, telephone, or wireless communication device to alert theviewer to the availability of the programming event, and to providerelated information such as the time and channel of the programmingevent and a description of the programming event.

[0147] Such a system is illustrated in FIG. 25, in which a metadatadistributor 200 supplies metadata 202 to a server 204, which determinespreferred programming events in accordance with a viewer profile andcommunicates programming alerts 206 to a communication device 208 of theviewer. The communication device may for example be a pager, cell phone,wireless communication device, telephone or computer. The server mayperform scoring processes as described above to assign scores toprogramming events using programming event metadata and a viewer profileprovided by the viewer. For example, as shown in FIG. 26, theprogramming event provider may receive a viewer profile from a viewer(210). A viewer may provide a viewer profile, for example, bytransmitting a previously established viewer profile to the serverthrough the internet, or by accessing the server through the internetand filling a form to provide appropriate viewer profile information. Asdescribed above, the viewer profile may include preference scoresassociated with categories of a classification hierarchy. The viewerprofile preferably contains contact information, such as an emailaddress or pager number, for indicating where an alert should be sentfor that viewer. The programming event provider also receives metadatafor one or more programming events (212). As described above, themetadata may include goodness of fit scores for categories of theclassification hierarchy. Metadata for programming events is processedusing the viewer profile to determine preferred programming events(214). An alert is then provided to the viewer's communication device(216). In preferred embodiments the alert is provided to the viewer'scommunication device using contact information such as an email addressor pager address that is included in the viewer profile. The alert maybe in the form of a text message for viewing, or in the case of wirelesscommunication devices such as digital cellular telephones, the alert maybe provided as a computer-generated spoken message. The manners oftransmitting data from a server to various communication devices asdescribed above is known in the art. The time at which the alert isprovided is preferably determined through reference to the time of thepreferred programming event and information in the viewer profilespecifying an amount of time in advance for providing alerts.

[0148] Although the processing of the aforementioned embodiment isdescribed as occurring in a server, alternative embodiments may locatethe same processing in a viewer's client device, such that the clientdevice receives metadata and processes the metadata to provideprogramming alerts to a viewer's communication device. The client devicein accordance with such embodiments will include an appropriateinterface for providing the programming alerts through a desiredcommunication system.

[0149] In further alternative embodiments, systems and processes asdiscussed above may be applied to programming events involving othertypes of media. For example, metadata may be generated for audioprograms or segments of audio programs, and the metadata may be analyzedusing viewer profiles to determine an alert list or programs to berecorded. Analogous processes may be applied to other media such aselectronic print media.

[0150] While the embodiments described herein include variouscombinations of features, those features may characterize furtherembodiments of the invention individually or in other combinations, andthus it will be apparent to those having ordinary skill in the art thatthe system features and processing tasks described herein are notnecessarily exclusive of other features and processing tasks, norrequired to exist in only those combinations particularly described, butrather that further alternative combinations may be implemented and thatadditional features and tasks may be incorporated in accordance withparticular applications. Therefore it should be understood that theembodiments described herein are offered by way of example only. Theinvention is not limited to these particular embodiment, but extends tovarious modifications, combinations, and permutations that fall withinthe scope and spirit of the appended claims.

What is claimed is:
 1. A method in a video production facility systemfor producing closed caption data for video programming events,comprising: receiving script data for a video program; determiningidentifiers of individual programming events within the program; andproducing closed caption data for the program, the closed caption datacomprising text data corresponding to said script data, and timing dataprovided at locations corresponding to beginnings of each of theprogramming events, the timing data corresponding to a programming eventcomprising an identifier of the corresponding programming event.
 2. Themethod claimed in claim 1, wherein said closed caption data furthercomprises timing data provided at locations corresponding to ends ofeach programming event.
 3. The method claimed in claim 1, wherein saidclosed caption data further comprises timing data provided at locationscorresponding to beginnings of segments within the programming events.4. The method claimed in claim 1, wherein said closed caption datafurther comprises timing data provided at locations corresponding toends of segments within the programming events.
 5. The method claimed inclaim 1, further comprising providing synchronized transmission of theclosed caption data and programming events.
 6. The method claimed inclaim 5, wherein providing synchronized transmission comprisessynchronizing transmission of the closed caption data to the display ofcorresponding text by a teleprompter system used in the production ofthe video program.
 7. The method claimed in claim 1, further comprisingstoring the programming events and the closed caption data on a machinereadable storage medium.
 8. The method claimed in claim 1, wherein thetiming data for a programming event comprises an identifier associatedwith the programming event and data indicating an amount of time bywhich the identifier precedes the beginning of the programming event. 9.The method claimed in claim 1, wherein the timing data for a programmingevent comprises an identifier associated with the programming event thatis inserted into the closed caption data at a location separated fromthe beginning of the programming event by a predetermined amount oftime.
 10. The method claimed in claim 1, wherein the timing data isencoded as hidden closed caption data.
 11. The method claimed in claim1, wherein said timing data is accompanied by a timing data marker. 12.The method claimed in claim 1, wherein said timing data is encrypted.13. A device for providing closed caption data for video programmingevents, comprising: at least one processor; and memory coupled to the atleast one processor and having stored therein programming instructionsto perform data processing, comprising: receiving script data for avideo program; determining identifiers of individual programming eventswithin the program; and producing closed caption data for the program,the closed caption data comprising text data corresponding to saidscript data, and timing data provided at locations corresponding tobeginnings of each of the programming events, the timing datacorresponding to a programming event comprising an identifier of thecorresponding programming event.
 14. The device claimed in claim 13,wherein said closed caption data further comprises timing data providedat locations corresponding to ends of each programming event.
 15. Thedevice claimed in claim 13, wherein said closed caption data furthercomprises timing data provided at locations corresponding to beginningsof segments within the programming events.
 16. The device claimed inclaim 13, wherein said closed caption data further comprises timing dataprovided at locations corresponding to ends of segments within theprogramming events.
 17. The device claimed in claim 13, furthercomprising providing synchronized transmission of the closed captiondata and programming events.
 18. The device claimed in claim 17, whereinproviding synchronized transmission comprises synchronizing transmissionof the closed caption data to the display of corresponding text by ateleprompter system used in the production of the video program.
 19. Thedevice claimed in claim 13, further comprising storing the programmingevents and the closed caption data on a machine readable storage medium.20. The device claimed in claim 13, wherein the timing data for aprogramming event comprises an identifier associated with theprogramming event and data indicating an amount of time by which theidentifier precedes the beginning of the programming event.
 21. Thedevice claimed in claim 13, wherein the timing data for a programmingevent comprises an identifier associated with the programming event thatis inserted into the closed caption data at a location separated fromthe beginning of the programming event by a predetermined amount oftime.
 22. The device claimed in claim 13, wherein the timing data isencoded as hidden closed caption data.
 23. The device claimed in claim13, wherein said timing data is accompanied by a timing data marker. 24.The device claimed in claim 13, wherein said timing data is encrypted.25. A method of generating closed caption data for a video program,comprising: producing closed caption data comprising timing data andtext data corresponding to at least an audio portion of the videoprogram, the timing data comprising beginning timing data provided atlocations in the closed caption data corresponding to beginnings ofprogramming events within the video program; producing a video signalfor the video program; and synchronizing the closed caption data to thevideo signal in accordance with display of corresponding text by ateleprompter system used in the production of the video program.
 26. Themethod claimed in claim 25, the timing data further comprising endtiming data provided at locations corresponding to ends of programmingevents.
 27. The method claimed in claim 25, the timing data furthercomprising segment beginning timing data provided at locationscorresponding to beginnings of segments within the programming events.28. The method claimed in claim 25, the timing data further comprisingsegment end timing data provided at locations corresponding to ends ofsegments within the programming events.
 29. The method claimed in claim25, further comprising transmitting the synchronized video signal andclosed caption data to client video reception devices.
 30. The methodclaimed in claim 25, further comprising storing the synchronized videosignal and closed caption data on a machine readable storage medium. 31.The method claimed in claim 25, wherein the timing data comprises anidentifier associated with a programming event of the televisionprogram.
 32. The method claimed in claim 25, wherein the timing datacomprises an identifier associated with a programming event of thetelevision program and data indicating an amount of time by which theidentifier precedes the beginning of the programming event.
 33. Themethod claimed in claim 25, wherein the timing data comprises anidentifier associated with a programming event of the television programthat is inserted into the closed caption data at a location separatedfrom the beginning of a programming event by a predetermined amount oftime.
 34. The method claimed in claim 25, wherein the timing data isencoded as hidden data.
 35. The method claimed in claim 25, wherein thelive television program is a news program.
 36. The method claimed inclaim 25, wherein the live television program is a home shoppingprogram.
 37. The method claimed in claim 25, wherein said timing data isaccompanied by a timing data marker.
 38. The method claimed in claim 25,wherein said timing data is encrypted.
 39. A system for providing closedcaption data for a video program, comprising: a video signal sourceproviding a video signal of the program; a closed caption data sourceproviding closed caption data including text data for the video programand timing data for programming events within the video program, thetiming data comprising beginning timing data provided at locations inthe closed caption data corresponding to beginnings of programmingevents within the video program; and a teleprompter system fordisplaying text to be read during production of the video program, theclosed caption data being synchronized to the video signal in accordancewith display of corresponding text by the teleprompter system.
 40. Thedevice claimed in claim 39, the timing data further comprising endtiming data provided at locations corresponding to ends of programmingevents.
 41. The device claimed in claim 39, the timing data furthercomprising segment beginning timing data provided at locationscorresponding to beginnings of segments within the programming events.42. The device claimed in claim 39, the timing data further comprisingsegment end timing data provided at locations corresponding to ends ofsegments within the programming events.
 43. The system claimed in claim39, further comprising a storage device for storing the video signal andthe synchronized closed caption data on a machine readable storagemedium.
 44. The system claimed in claim 39, further comprising atransmitter for providing the video signal and the synchronized closedcaption data to a transmission medium.
 45. The device claimed in claim39, wherein said timing data is accompanied by a timing data marker. 46.The device claimed in claim 39, wherein said timing data is encrypted.47. A machine readable storage medium storing signals representing avideo program, the signals comprising: a video signal representing avideo portion of the video program; and closed caption data comprisingtext data corresponding to at least an audio portion of the videoprogram, and timing data comprising identifiers of programming eventsused in metadata describing the programming events, the locations of thetiming data in the closed caption data corresponding to beginnings ofcorresponding programming events within the video program.
 48. Thestorage medium claimed in claim 47, wherein said timing data isaccompanied by timing data markers.
 49. The storage medium claimed inclaim 47, wherein said timing data is encrypted.
 50. A method in a videoproduction facility system for producing a video, comprising:determining programming events within a video program; determiningidentifiers of the programming events; and producing a video signal forthe program, the video signal comprising timing data provided atlocations corresponding to beginnings of each of the programming events,the timing data corresponding to a programming event comprising anidentifier of the corresponding programming event.
 51. The methodclaimed in claim 50, wherein said video signal further comprises timingdata provided at locations corresponding to ends of each programmingevent.
 52. The method claimed in claim 50, wherein said video signalfurther comprises timing data provided at locations corresponding tobeginnings of segments within the programming events.
 53. The methodclaimed in claim 50, wherein said video signal further comprises timingdata provided at locations corresponding to ends of segments within theprogramming events.
 54. The method claimed in claim 50, wherein saidtiming data is provided in vertical blanking intervals of the videosignal.
 55. The method claimed in claim 50, wherein said timing data isprovided in data fields of a digital video signal.
 56. The methodclaimed in claim 50, further comprising storing the video signalincluding the timing data on a machine readable storage medium.
 57. Themethod claimed in claim 50, wherein the timing data for a programmingevent comprises an identifier associated with the programming event anddata indicating an amount of time by which the identifier precedes thebeginning of the programming event.
 58. The method claimed in claim 50,wherein the timing data for a programming event comprises an identifierassociated with the programming event that is inserted into the videosignal at a location separated from the beginning of the programmingevent by a predetermined amount of time.
 59. The method claimed in claim50, wherein said timing data is accompanied by a timing data marker. 60.The method claimed in claim 50, wherein said timing data is encrypted.61. A device for providing closed caption data for video programmingevents, comprising: at least one processor; and memory coupled to the atleast one processor and having stored therein programming instructionsto perform data processing, comprising: determining programming eventswithin a video program; determining identifiers of the programmingevents; and producing a video signal for the program, the video signalcomprising timing data provided at locations corresponding to beginningsof each of the programming events, the timing data corresponding to aprogramming event comprising an identifier of the correspondingprogramming event.
 62. The device claimed in claim 61, wherein saidvideo signal further comprises timing data provided at locationscorresponding to ends of each programming event.
 63. The device claimedin claim 61, wherein said video signal further comprises timing dataprovided at locations corresponding to beginnings of segments within theprogramming events.
 64. The device claimed in claim 61, wherein saidvideo signal further comprises timing data provided at locationscorresponding to ends of segments within the programming events.
 65. Thedevice claimed in claim 61, wherein said timing data is provided invertical blanking intervals of the video signal.
 66. The device claimedin claim 61, wherein said timing data is provided in data fields of adigital video signal.
 67. The device claimed in claim 61, furthercomprising storing the video signal including the timing data on amachine readable storage medium.
 68. The device claimed in claim 61,wherein the timing data for a programming event comprises an identifierassociated with the programming event and data indicating an amount oftime by which the identifier precedes the beginning of the programmingevent.
 69. The device claimed in claim 61, wherein the timing data for aprogramming event comprises an identifier associated with theprogramming event that is inserted in to the video signal at a locationseparated from the beginning of the programming event by a predeterminedamount of time.
 70. The device claimed in claim 61, wherein said timingdata is accompanied by a timing data marker.
 71. The device claimed inclaim 61, wherein said timing data is encrypted.